The Application of Control Using Neuro-dynamic Programming with Featruing Method

For the general nonlinear processes control problem, the most rigorous approach is to use dynamic optimization. However, as the size of the problem grows, the Dynamic Programming (DP) approach is suffered from the burden of calculation which is called as 'Curse of Dimensionality'. To overcome this problem, a costapproximator can be used to obtain the optimal control input policy minimizing the value of cost, called the Neuro-Dynamic Programming (NDP) algorithm. In this study, the NDP algorithm was applied to pH neutralization process in both simulations and experiments. A systematic approach of NDP to a pH neutralization process has been proposed and the performance of the NDP approach has been evaluated through the comparison with PI control. Also, a few related issues such as selection of approximator and a feature map of the states are investigated. Copyright © 2005 IFAC